GEOMETRIC COLLECTIONS AND CASTELNUOVO-MUMFORD 

REGULARITY 



L. COSTA*, R.M. MIRO-ROIG** 

Abstract. The paper begins by overviewing the basic facts on geometric exceptional 
collections. Then, we derive, for any coherent sheaf J- on a, smooth projective variety 
with a geometric collection, two spectral sequences: the first one abuts to ^ and the 
second one to its cohomology. The main goal of the paper is to generalize Castelnuovo- 
Mumford regularity for coherent sheaves on projective spaces to coherent sheaves on 
smooth projective varieties X with a geometric collection a. We define the notion of 
regularity of a coherent sheaf T on X with respect to a. We show that the basic formal 
properties of the Castelnuovo-Mumford regularity of coherent sheaves over projective 
spaces continue to hold in this new setting and we show that in case of coherent sheaves 
on P" and for a suitable geometric collection of coherent sheaves on both notions of 
regularity coincide. Finally, we carefully study the regularity of coherent sheaves on a 
smooth quadric hypersurface Q„ C P"+i (n odd) with respect to a suitable geometric 
collection and we compare it with the Castelnuovo-Mumford regularity of their extension 
by zero in P"+^. 
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1. Introduction 

The goal of this paper is to extend the notion of Castelnuovo-Mumford regularity for 
coherent sheaves on projective spaces to coherent sheaves on smooth projective varieties 
with a geometric collection with the hope to apply it to study coherent sheaves on smooth 
projective varieties. As a main tool we use geometric collections of exceptional sheaves 
and helix theory. 

Exceptional bundles were first considered in [2] by Drezet and Le Potier, where they 
were used to determine the set of triples (r, ci, C2) such that there exists a semistable sheaf 
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£ on with rank r and Chern classes ci and C2; and to describe moduli spaces of stable 
vector bundles on P^. In the succeeding papers [8J, [TT], [T3j and ^23j, the notion of 
exceptional bundle on was extended to other manifolds X and even more from the 
category of vector bundles on X to the bounded derived category of coherent sheaves on 
X. 

Any exceptional collection {£q,£i, ■ ■ ■ ,£m) gives rise to a bi-infinite collection, {£i}i,zz, 
called helix and defined recursively by left and right mutations (see Definition 12. 12|) . Helix 
theory was introduced by Drezet and Le Potier in and by Gorodentsev and Rudakov 
in JT], in connection with the problem of constructing exceptional bundles on P"; and 
helix theory got its further progress in the succeeding papers f^, 0, P, [HI, [HI, [22| 
and Again helix theory was first developed for vector bundles on P^ and generalized 
later to any triangulated category where for any two objects £ and J^, Hom*(6^,jF) has a 
structure of finite dimensional graded vector space over C. 

In this paper, we make an effort to link the abstract and general context of helix theory 
and exceptional collections to concrete examples, their applications, and the geometrical 
properties that we can derive. First of all, we recall the notion of geometric collection 
(see Definition I2.15|) introduced by Bondal and Polishchuk in [3 . It is well known that 
the length of any full exceptional collection of coherent sheaves a = {£q,£i, ■ ■ ■ ,£m) on 
a smooth projective variety X of dimension n is equal to the rank of the Grothendieck 
group Kq{X) which turns out to be greater or equal to n + 1. We call geometric collection 
any full exceptional collection of coherent sheaves of length n + 1. Geometric collections 
have nice properties: They are automatically full strongly exceptional collections, their 
strong exceptionality is preserved under mutations, any thread of an helix associated to 
a geometric collection is a full strongly exceptional collection, etc... 

We address the problem of determining smooth projective varieties with geometric 
collections and we prove that P", any quadric hypersurface Qn C P"+^ (n odd) and 
any Fano 3-fold X with Pic{X) = Z and trivial intermediate Jacobian have geometric 
collections. Given a coherent sheaf on a smooth projective variety X with a geometric 
collection, we derive two spectral sequences: A Beilinson-Kapranov type spectral sequence 
which converges to J-' (Theorem I2.21|) and an Eilenberg- Moore type spectral sequence 
which abuts to the cohomology of JF f Theorem I2.22|) . 

The existence of geometric collections allows us to generalize the notion of Castelnuovo- 
Mumford regularity for coherent sheaves on projective spaces to coherent sheaves on 
smooth projective varieties with a geometric collection fDefinition 13. ip . We also prove 
that many of the main properties of the Castelnuovo-Mumford regularity are accomplished 
by this new concept. Finally, given a smooth projective variety X-^P" with a geomet- 
ric collection a and a coherent (9x-niodule J-' it would be very interesting to compare 
the regularity of JF with respect to a, Regcr{J-^), to the Castelnuovo-Mumford regularity 
Reg^^^ {i^T) of its extension by zero In the last part of this work, we will address 
this problem and we will show by carefully analyzing the cases of coherent sheaves on 
quadric hypersurfaces Qn C P"'+^ [n odd) that, in general, they are very different and we 
write down a formula which relates both notions of regularity f Theorem 14. 3|) . 
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Next we outline the structure of this paper. In section 2, we overview the basic facts 
on exceptional collections, geometric collections, mutations and helix theory; we give 
examples to illustrate all these concepts, and we describe the spectral sequences that 
we use in the sequel to develop the theory of regularity with respect to a geometric 
collection. In section 3, we give, using a Beilinson-Kapranov type spectral sequence, the 
promised definition of regularity with respect to a geometric collection, we prove that the 
Castelnuovo-Mumford regularity of a coherent sheaf T on coincides with the regularity 
of T with respect to a suitable geometric collection of coherent sheaves on P" and we show 
that the main basic properties of the Castelnuovo-Mumford regularity carry over to the 
new setting. In section 4, we consider odd dimensional quadric hypersurfaces Qn C P"+^ 
and their geometric collection a = {Oq^,Oq^{1), ■ ■ ■ ,OQ^{n — l),S(n — 1)), where S 
is the Spinor bundle. We compute the right dual basis of any thread of the strict helix 
Tia — associated to cr, we illustrate our results on the regularity of a sheaf with 

respect to a for the case of sheaves JF on and we compare it with the regularity of its 
extension by zero in the embedding C P**"*"^. This last results show that, in general, the 
regularity with respect to cr of a coherent sheaf ^ on a smooth projective variety X^¥^ 
does not square with the Castelnuovo-Mumford regularity of its extension by zero in 
pm gj^^ |;]^g paper in §5 with some final comments and questions which naturally 
arise from this paper. 



2. Geometric collections and spectral sequences 

Let X be a smooth projective variety defined over the complex numbers C and let 
T) = D^{Ox-'mod) be the derived category of bounded complexes of coherent sheaves of 
Ojf-niodules. For any pair of objects A, B E Obj(T>) we introduce the following notation: 

Hom'(A, S) := Ext^{A, B) 

and if V' is a graded vector space and A an object of D, then the tensor product can be 

constructed as 

(2.1) V® A = 0y"®yl[-a]. 

We will use the duahzation defined for graded vector spaces by the rule 

(2.2) (\/x-), = {V'U. 

A covariant cohomological functor Cov* is called linear if for any (5 satisfies 

(2.3) Cov^(y ® A) = CoY^ {A[-a]) = ® Cov^-"(A). 

Q a 

Definition 2.1. Let X be a smooth projective variety. 

(i) An object T &Vis exceptional if Hom*(jF, JF) is a 1-dimensional algebra generated 
by the identity. 

(ii) An ordered collection (^o, -^i, ■ • ■ , ^m) of objects of V is an exceptional collection 
if each object is exceptional and Ext^(.F'fc, Jv,) = for j < k. 
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(iii) An exceptional collection (JFq, jFi, ■ ■ ■ , JF^) of objects of "D is a strongly excep- 
tional collection if in addition Ext^(jFj, JF;,) = for i and j < k. 

(iv) An ordered collection of objects of V, (JFq, JF^, ■ ■ ■ ,J^m), is a full (strongly) ex- 
ceptional collection if it is a (strongly) exceptional collection (JFq, T\^ - ■ ■ , Tm) and JFq, 

■ ■ ■ , generate the bounded derived category V. 

Example 2.2. (1) (Cp., Op.(l), Op.(2), Op.(r)) and (Opr, %r{l), ^^.(2), 
f2pr(r)) are full strongly exceptional collections of coherent sheaves on P*". 

(2) Let Gr{k, n) be the Grassmannian of A;-dimensional subspaces of the n-dimensional 
vector space and let S be the tautological fc- dimensional bundle on X. Denote by Tf^S 
the space of the irreducible representations of the group GL{S) with highest weight a = 
(«!,..., Og) and |a| = J2i=i^i- Denote by A{k,n) the set of locally free sheaves S"iS 
on Gr{k,n) where a runs over Young diagrams fitting inside a A; x {n — k) rectangle. 
Set p{k,n) := ^A{k,n). By [T3]; Proposition 2.2 (a) and Proposition 1.4, A{k,n) can 
be totally ordered in such a way that we obtain a full strongly exceptional collection 
{El, . . . , Ep(k^n)) of locally free sheaves on Gr{k, n). 

(3) Let Qn C P"+^, n > 2, be the quadric hypersurface. By [T3]; Proposition 4.9, if n 
is even and Si, S2 are the Spinor bundles on Qn, then 

(Si(-n), S2(-n), + 1), ■ ■ ■ , Oq„(-1), 0qJ 

is a full strongly exceptional collection of locally free sheaves on Qn, and if n is odd and 

5 is the Spinor bundle on Qn, then 

(S(-n), + 1), ■ • ■ , Oq„(-1), OqJ 

is a full strongly exceptional collection of locally free sheaves on Qn- 

Remark 2.3. The existence of a full strongly exceptional collection (jFo,jFi, ■ ■ ■ ,JF^) of 
coherent sheaves on a smooth projective variety X imposes a rather strong restriction on 
X, namely that the Grothendieck group K(){X) = Kq{Ox — mod) is isomorphic to Z'"^^. 

Definition 2.4. Let X be a smooth projective variety and let {A, B) be an exceptional 
pair of objects of V. We define the left mutation of B, L^B, and the right mutation 
of A, RbA, with the aid of the following distinguished triangles in the category V: 

(2.4) LaB Rom'{A, B) ® A ^ B ^ LaB[1\ 



(2.5) RbA[-1] ^ A^ Hom^'(y4, B) ® B ^ RbA. 

Remark 2.5. If we apply Hom*(y4, ■) to the triangle (j2.4|) and we apply Hom*(-,i?) to 
the triangle ()2.5|) we get the following orthogonality relations: 

Hom'(A, LaB) = and Hom'(i?ijy4, B) = 0. 

Definition 2.6. Let X be a smooth projective variety and let a = {Sq, ■ ■ ■ ,Sn) be an 
exceptional collection of objects of V. A left mutation (resp. right mutation) of a is 
defined as follows: for any 1 < i < n a left mutation Li replaces the i-th pair of consequent 



GEOMETRIC COLLECTIONS AND CASTELNUOVO-MUMFORD REGULARITY 5 

elements {Si-i,£i) by {L£._j^£i,£i_i) and a right mutation Ri replaces the same pair of 
consequent elements {Si-i,£i) by {£i, Rs.£i-i): 

Lid = L£._^a = {£q, ■ ■ ■ , L£._-^£i, £i-i, ■ ■ ■ En) 

Ria = R£i_^cr = (Sq, ■ ■ ■ ,£i, R£.Si_i, ■ ■ ■ , Sn)- 

Notation 2.7. It is convenient to agree that 

R^^^S^ = R^'-'^RS^ = Rs^^^ Rs.+,Rs.^A 

and similar notation for compositions of left mutations. According to these notations, 
mutations satisfy the following relations: 

LiRi = RiLi = Id 

LiLj = LjLi for \i — j\ > 1 

Li+iLiLi+i = LiLi+iLi for 1 < 2 < n. 

Proposition 2.8. Let X be a smooth projective variety and let a = {Sq, ■ ■ ■ ,Sn) be an 
exceptional collection of objects ofD. Then any mutation of a is an exceptional collection 
and if a generates the category V, then the mutated collection also generates V. 

Proof. See [2]; Assertion 2.1 and Lemma 2.2. □ 

Remark 2.9. In general a mutation of a strongly exceptional collection is not a strongly 
exceptional collection. For instance, let X = x be a smooth quadric surface in 
and denote by Ox{ci, b) = Opi{a) Kl Cpi(6). By [11; Proposition 4.16, (see also i5j 

a = (Ox,Ox(l,0),Ox(0,l),Ox(l,l)) 
is a full strongly exceptional collection of line bundles on X. Using the exact sequence 
^ Oxi-l, 1) ^ Hom(Ox(0, 1), 1)) ® 0x(0, 1) ^ 1) ^ 

we get that Lox{o,i)Ox{l, 1) = Ox{-l, 1). But, since Ext^(Cx(l, 0), 1)) = C the 

mutated exceptional collection of line bundles on X 

La = {Ox, Ox{l, 0), Ox{-l, 1), Ox{0, 1)) 

is no more a strongly exceptional collection of line bundles on X. We will come back to 
the problem of whether strongly exceptionality is preserved under mutations. 

Definition 2.10. Let X be a smooth projective variety. Given any full exceptional 
collection a = {Sq, ■ ■ ■ , Sn) the collection 

will be called left dual base of cr and the collection 

will be called right dual base of a. 
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Remark 2.11. Given a full exceptional collection a = {So,-- - ,Sn), its corresponding 
right and left dual basis are uniquely determined up to a unique isomorphism and they 
satisfy the following orthogonality conditions: 

Hom"(/2(^)^i, Sk) = 0, Hom"(^fc, L^^^Si) = 

for all a,i,j and k except 

Hom'(i?(^)£„_fc,£„_fc) = Hom"-'(£„_,,L("-'=)£:„_fc) = C. 

The definition of helix and the first results about helices appeared in [7j and . Let 
us recall its definition. 

Definition 2.12. Let X be a smooth projective variety. A helix of period n + 1 is 
an infinite sequence {£i}iQZ of objects of V such that for any i G Z, {Si, - - - ,£i+n) is an 
exceptional collection and £n+i+i = R^"'^Si- 

Any exceptional collection of objects of V, a = {£q, - - - , Sn), induces a unique helix by 
the rule 

(2.6) Sn+i = R^'^^Si-i and S.i = L^'''>£n-i+i, i > 0. 

In that case we say that the helix is generated by a and that the collection Tia '■= 

is the helix associated to a. Each collection o", = {Si,Si+i, - - - ,Si+n) is called a thread 

of the helix and it is clear that a helix is generated by any of its thread. 

Example 2.13. Let a = (Cpr, Cpr(l), Cpr(2), ■ ■ ■ , Opr{r)) be the full exceptional collec- 
tion of line bundles on P*" = F{V) given in Example 12.21 (1). The helix associated to a is 
given by = {Cp'-(^)}jez- Indeed, denote by £i = Opr{i), < i < r. By definition, for 
any i > 0, £r+i = R^'^^£i-i and £-i = L^'^^£r-i+i. Using the exterior powers of the Euler 
sequence 

(2.7) — y A^'-^Tpr — > A^V ® Opr{k) — > A^Tpr — > 
we deduce that for any A; > 

R^''^£o = Rs^Re^^^ - - - Rei£o = A^Tpr. 

So, in particular we get £r+i = R^'^^£o = A'"Tpr = Opr{r + 1). More in general, repeating 
the process and using once more the exact sequence ()2.7|) we get 

£r+i = R^'^£i-i = A'Tpr{i - 1) = Cp,.(r + i). 

Analogously, we deduce that £'_j = Opr(— i) and hence we get that the helix associated to 
a is given by Ti^ = {Cp'-(i)}igz- Notice that in this case, any thread CTj = {Or{i), Opr{i + 
1), Opr{i + 2), ■ ■ ■ , Ofr{i + r)) of the helix is again a full strongly exceptional collection of 
line bundles. Moreover, we have that for any z G Z, 

£i = £i+r+l ® Kpr^ 

where Kpr = Opr{—r — 1) is the canonical line bundle. 
This last observation is indeed a more general fact: 
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Remark 2.14. Let X be a smooth projective variety of dimension m and let a = 
{£q, ■ ■ ■ ,£n) be a full exceptional collection of objects of V. Then the helix TCa asso- 
ciated to cr has the following property of periodicity: for any i G Z, 

Si = Si+n+i ^Kxlm- n] 

where Kx is the canonical line bundle on X and the number in square brackets denotes 
the multiplicity of the shift of an object to the left viewed as a graded complex in V. 

Bondal and Polishchuk introduced in [2] the notion of geometric collection as the ex- 
ceptional collection a of objects of V that generates a geometric helix, i.e., an helix 
Ha = such that for any A; > and any i < j, Ext^ {Si, Sj) = 0. Then they proved 

that full geometric collections are exactly full exceptional collections of length equal to the 
dimension of the variety plus one (see Proposition 3.3). We find it more convenient 
to use this latter property as the definition: 

Definition 2.15. Let X be a smooth projective variety of dimension n. We call geo- 
metric collection to any full exceptional collection of coherent sheaves on X of length 
n + 1 and we call strict helix to the helix generated by it. 

Remark 2.16. (1) Notice that since all full strongly exceptional collections of coherent 
sheaves on X have the same length and it is equal to the rank{KQ{X)) > n + 1, the length 
of a geometric collection is the minimum possible. 

(2) The existence of a geometric collection on a smooth variety X imposes a strong 
restriction on X, namely that its Grothendieck group Kq{X) = and X is forced 

to be a Fano variety (see P]; Theorem 3.4). 

Geometric collections have a nice behavior. For instance, geometric collections are 
automatically strongly exceptional collections of coherent sheaves and its strongly excep- 
tionality is preserved under mutations (Recall that, in general, strongly exceptionality is 
not preserved under mutations as we have showed in Remark 12. 9|) . More precisely we 
have: 

Proposition 2.17. Let X be a smooth projective variety of dimension n and let a = 
{So, ■ ■ ■ ,Sn) be a geometric collection of coherent sheaves on X . Then, 

(i) Any mutation of the collection o consists also of sheaves, i.e. complexes concentrated 
in the zero component of the grading. 

(a) The collection a is a full strongly exceptional collection of coherent sheaves. 

(Hi) Any mutation of a is a full strongly exceptional collection of coherent sheaves. 

(iv) Any thread {Si,Si+i, ■ ■ ■ ,Sn+i) of the helix TCa associated to a is a full strongly 
exceptional collection of coherent sheaves on X . 

Proof. It follows from Assertion 9.2, Theorem 9.3 and Corollary 9.4. □ 

Example 2.18. According to Example 12. 2[ there exists a geometric collection of coherent 
sheaves on and on Qn C P""*"^, n odd, and hence both varieties have strict helices. On 
the other hand, there are no geometric collections of coherent sheaves on Qn for n even 
and on Gr{k, n) = Gr{k, V),2 <k <n-2. 
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Proposition 2.19. Let X be any smooth Fano threefold with Pic{X) = Z and trivial 
intermediate Jacobian. Then, X has a geometric collection. 

Proof. According to the classification of Fano threefolds X with Pic{X) = Z and trivial 
intermediate Jacobian ([13j; Table 3.5), there exist four kinds of such manifolds: The 
projective space P^, a smooth quadric C P^, the manifold V5 C P^ and the family of 
manifolds 1^22 C P^^. The cases X = and X = Q3 follow from Example EH (1) and 
(2), respectively. The case X = V5 is due to Orlov ([20]) and the case X = V22 is due to 
Kuznetsov (P^; Theorem 3). □ 

Remark 2.20. Restricting ourselves to the strict helix area a = {Sq, ■ ■ ■ ,Sn) all the 
theory can be pulled down from the triangulated category V = D^^Ox-mod) of bounded 
complexes of coherent sheaves into the category of coherent sheaves Coh(X). For instance, 
for any i < j the canonical distinguished triangles 

(2.8) Ls^Sj Hom* {Si, Sj) ® £i ^ £, Ls^£, [1] 

(2.9) ReM-^] Hom^'(^,, E^) ® ^ 
turn to usual triples of coherent sheaves 

(2.10) ^ Le,Ej Hom(^i, Ej) ^ Ei ^ Ej ^ 



(2.11) O^Ei^ Hom*(£i, Ej) ® Ej Re£i 0. 

So, without loss of generality, we could define the mutations inside a strict helix in terms 
of sheaves. 

Theorem 2.21. (Beilinson-Kapranov type spectral sequence) Let X be a smooth 
projective variety of dimension n with a geometric collection a = {Eq,Ei, ■ ■ ■ ,En) and let 
Tier = {Ei}i(zz be the associated strict helix. Then for any thread cTi = {Ei, ■ ■ ■ , Ei^n) of the 
helix Tirj and any coherent sheaf on X there is a spectral sequence with Ei-term 

(2.12) = Ext^(i?(-P)£,+„+p, ® Ei+p+n 
situated in the square < q < n, —n < p < which converges to 



E. 



00 



JF for i = 
/or 2 ^ 0. 



Proof. First of all notice that since the helix Ti^ is strict, the thread CTj = {Ei, ■ ■ ■ ,£^i+„) 
also generates the category V. We write V' for the graded vector spaces 

y; = Hom'(i?("-'=)£fc+,,.F) 

and we consider the complex 

L' -.Q^V^ ®Ei^ ® ^ > V:_^ ® Ei^n-1 ^ V* ® Ei+n ^ 

where the tensor product is defined as in ()2.1|) . The right mutations produce a canonical 
right Postnikov system of the complex L*, which naturally identifies with the canonical 
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right convolution of this complex. Then, for an arbitrary linear covariant cohomological 
functor there exists an spectral sequence with i?i-term 

i^pg = $9 (LP) 

situated in the square < p,q < n and converging to $p+^(JF) (see 1.5). Since $* is 
a linear functor, it follows from ()2.3|) that 

(2.13) = ^^{v; ® s,^,) = 1^ ® = ^; ® ^^{S^+p)■ 

I a+l3=q 

In particular, if we consider the covariant linear cohomology functor which takes a complex 
to its cohomology sheaves and acts identically on sheaves, i.e. 

V for /3 = 
for /3 7^ 

on any sheaf in the square < p, g < n, we get 

^El'^ = ® Si+p = Ext'?(i?("-?')£:p+i, ® Si+p 

where the last equality follows from the definition of V* . Finally, if we call p' = p — n we 
get the spectral sequence with i^i-term 



$^(^) 



= Ext«(/2(-P')£:p,+„+„ ^) ® £p,^^+i 
in the square < q < n, —n < p' < and which converges to 

, ^ for z = 
°° [0 for I ^ 0. 

□ 

Theorem 2.22. (Eilenberg-Moore type spectral sequence) Let X be a smooth 
projective variety of dimension n with a geometric collection a = {Sq,Si, ■ ■ ■ ,Sn) and let 
Ha = {£i\iez he the associated strict helix. Then for any thread ai = {£i, ■ ■ ■ , £i+n) of the 
helix Ha and any pair of coherent sheaves J-", Q on X there is a spectral sequence with 
El-term 

(2.14) = Ext°(i?(-^')£:,+„+p, J') Ext^iG, £,+p+n) 

a+l3=q 

situated in the square < q < n, —n < p < which converges to 



El 



Ex\F^\g,r) fori = 
fori^ 0. 



Proof. We follow step by step the proof of Theorem 12 . 2 1 1 but in this case in fl2.13p we take 
as $• the covariant functor Hom*(^, ■) and in such a way we get the spectral sequence 

^£;f= Ext"(i?(-P)£,+„+p,.F)®Ext'^(e?,^,+p+0 

a+l3=q 

situated in the square < g < n, — n < p < which converges to $P'^''(JF) = Ext^'''''(^, JF). 

□ 
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We will end this section with technical results that will be used in next sections. 

Lemma 2.23. Let X be a smooth projective variety of dimension n and let a = {So, ■ ■ ■ , Sn) 
be a geometric collection of coherent sheaves on X . For any i < j and any invertible sheaf 
T , it holds: 

(a) {Le£,y = Re^S*; 

(b) {Re£d* = Le*£*; 

(c) {Re£i) ®J' = Re.^A^i ® ^) and {Le£j) ® = L^^^A^^ ® J^). 

Proof, (a) According to Remark r2.20| ()2.10|) . L^.Sj is given by the aid of the exact sequence 

(2.15) ^ L££j Hom(^i, Sj) ® Si ^ Sj 0. 

Dualizing this exact sequence we get 

^ ^ Hom(£';, £*) ® £* ^ Hom*(^i, £j) ® £* ^ 

which according to Remark B.2U1 (|2.1ip gives that (L^-Sj)* = Re*^j- 

(b) The proof is analogous to the proof of (a). 

(c) Since Hom(£^j, = Hom(£^j ® ^^^j ® it is enough to tensor by JF the exact 
sequences 

Ls-£j Hom(£^j, £.j) ® Si £j ^ Q 

and 

□ 

Corollary 2.24. Let X be a smooth projective variety of dimension n with canonical line 
bundle K and let a = {£o, ■ ■ ■ ,£n) be a geometric collection of coherent sheaves on X . 
Assume that r = (jFg, ■ ■ ■ is the right dual base of a. Then, for any integer X, the 
right dual base of a x{n+i) = i£x{n+i),^x{n+i)+i, ■ ■ ■ ,^x{n+i)+n) is 

rxin+i) = (-^0 ® iKT\ ^1 ® ■ ■ ■ , ® (KT^) . 

Proof. By definition of right dual base we have 

J^j = R^^^£n-j 0<j<n. 
On the other hand, by Remark 12.141 

Sxin+l)+^ =S,® {K*r^. 

Therefore, applying Lemma [2.231 we get 

R^^^£xin+l)+n-j = R^'\£n-, ® (i^*)®") = iR^'^£n-,) ® (K*)^^ = ® {K*)®^ . 

□ 
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3. Regularity with respect to geometric collections: definition and 

properties 

In this section, using the so-called Beilinson-Kapranov spectral sequence, we generalize 
the notion of Castelnuovo-Mumford regularity for coherent sheaves on a projective space 
to coherent sheaves on a smooth projective variety with a geometric collection of coherent 
sheaves. We establish for coherent sheaves on P" the agreement of the new definition of 
regularity with the old one and we prove that many formal properties of Castelnuovo- 
Mumford regularity continue to hold in our more general setup. 

Let X be a smooth projective variety of dimension n and let a = {Sq, Si, - ■ ■ , Sn) be a 
geometric collection on X. Associated to a we have a strict helix TC^ = {^j}jez; and for 
any collection (Xj = {Si, Si+i, ■ ■ ■ , Si+n) of n + 1 subsequent sheaves (i.e. for any thread of 
the helix Ha) and any coherent Ox-module JF a spectral sequence (See Theorem 12. 2 ip 



(3.1) = Ext'?(i?(-P)^,+p+„, ^) ® S,+p+n 

situated in the square < q < n, —n < p < which converges to 



El 



JF for z = 
for 2 ^ 0. 



Definition 3.1. Let X be a smooth projective variety of dimension n with a geometric 
collection a = {So,Si, ■ ■ ■ ,Sn) and let be a coherent Ox-module. We say that JF is 
m-regular with respect to a if Ext'^(i?'^~^)£^_m+p, .F) = for g > and —n < p < 0. 



So, JF is m-regular with respect to a if -^-'^Ef'' = for g > in (jH.lj) . In particular, if 
JF is m-regular with respect to a the spectral sequence -"■-'^E^'^ collapses at E2 and we 
get the following exact sequence: 

(3.2) — > C^n — ^ ' — > Co — — >0 

where Cp = H^{X, {R^-P^S^rn+pY ® -F) ® ^-m+p for -n < p < 0. 



Definition 3.2. Let X be a smooth projective variety of dimension n with a geometric 
collection a = {So, Si, ■ ■ ■ ,Sn) and let JF be a coherent Ox-module. We define the regu- 
larity of JF with respect to a, Reg(j{T), as the least integer m such that JF is m-regular 
with respect to a. We set Rega{J-') = —00 if there is no such integer. 

Remark 3.3. It would be nice to characterize the sheaves J-" on X with Rega{!F) = —00. 

Example 3.4. Let y be a C- vector space of dimension n + 1 and set P" = P(y). We 
consider the geometric collection a = {Ofn, Opn(l), ■ ■ ■ , Opn(n)) on P" and the associated 
strict helix Ha = {Opn(i)}jg2 (see Example I2.13|) . Using the exterior powers of the Euler 
sequence 

— > A^-^Tpn — y A^V ® Orn{k) — > A^T^^ — ^ 
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we compute the right dual basis of any thread ctj = ((9pn(i), Opn(i + 1), ■ ■ ■ , Opn{i + n)) 
of the hehx Ha and we get 

(Opn(n + i),/?WOpn(i + n- I),-- - ,R^^^Opn{i + n- ]),■■■ , R^^'^Of^ii)) 

= (Opn(n + 2),Tpn(i + n- I),-- - ,A^Tpn(2 + n-j),--- ,A''Tpn{i)). 

Therefore, for any coherent sheaf on P" our definition reduces to say: is m-regular 
with respect to a if Ext«(A-Pr(-m JF) = i^9(P", Q-P^m - ® JF) = for all g > 
and all p, —n < p < 0. 

We now compute the regularity with respect to a = {£q, Si, - ■ ■ , £n) of the sheaves £i. 

Proposition 3.5. Let X he a smooth projective variety of dimension n with a geometric 
collection a = {£o,Si, ■ ■ ■ ,£n) o^nd let Ha = {£i\i^i he the associated strict helix. Then, 
for any i G Z, Rega{£i) = —i- 

Proof. First of all we will see that Rega{£i) < — By Remark 12 .51 we have 
Ext^(/?(-^')£,+„ £,) = Ext" (Re, ■ ■ ■ Re^^.^^Re^^.^A+v^ ^i) = 

for g > and —n < p < 0. So, £i is (— i)-regular with respect to cr or, equivalently, 
Rega{£i) < -i. 

Let us now see that £i is not {—i — l)-regular with respect to a. To this end, it is 
enough to see that there is g > and there is p, —n < p < 0, such that 

Ext''(i?(-P)^,+i+p,^,)^0. 

To prove it, we write i = an + j with < j < n, a G Z, we consider the thread 

O'an = {£an,£an+l, ' ' ' , £an+j = £i, ' ' ' , £an+n) 8Jld WC COUStrUCt itS right dual basis (sCe 

Definition ITTn|l 

(£ _L R'^^^£ _l 1 ■■■ R^"''^^£ ■■• R'^'^^£ ) 
It follows from Remar k |2 . 1 1 1 1 hat 

Ext ■'{R^ ■'^£an+j,£an+j) = Ext ^ {Rean+n^^^an+n-i ' ' ' ^San+j+i^ctn+j , £an+j) = C. 

We consider the exact sequence 

^ RSan+n-l ' ' ' RSc„+j+i^an+j ^ Hom* (_R£-^^_^^_ • • • Re^^n+j +iSan+j , £an+n) ® £an+n 

^ ^£an + n-^£an + n-l ' ' ' ^Can+j + l^an+j ^ 

and we apply the contravariant functor Hom(., Since Ext'' {£an+n,£an+j) = for 

g > 0, we get 

Ext" ^ ^{Rea„+n-i ■ ■ ■ RScn+j+i^an+j , £an+j) = C. 

We repeat the process using the consequent right mutations and we get 

Ext {RSa„+n-k ' ' ' RSan+j+Aan+ji £an+j) = C 

for 0<A;<ri— 1— j. In particular, 

Ext\Rs^^AA^)=^ 

which implies that £i is not (— z — l)-regular and we conclude that Rega{£i) = —i- □ 
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In ^7j, Lecture 14, D. Mumford defined the notion of regularity for a coherent sheaf 
over a projective space. Let us recall it. 

Definition 3.6. A coherent sheaf T on P" is said to be m-regular in the sense of 
Castelnuovo-Mumford if i/*(P", jF(m — z)) = for i > 0. We define the Castelnuovo- 
Mumford regularity of JF, Reg'^^\T\ as the least integer m such that T is m-regular. 

Notice that such an m always exists by the ampleness of (9pn(l) ( 12j; Chap. Ill, 
Proposition 5.3). 

Let us now establish for coherent sheaves on P" the agreement of regularity definition 
in the sense of Definit ion 13 . 1 1 with Castelnuovo-Mumford definition. 

Proposition 3.7. A coherent sheaf J-" on = F{V) is m-regular in the sense of 
Castelnuovo-Mumford if and only if it is m-regular with respect to the geometric collection 
a = (Opn, Cpn(l), ■ ■ ■ , Opn(n)). Hence, we have 

Reg^{J^) = Reg''''{J^). 

Proof. According to Definitions 13.11 and 13.61 and Example 13.41 we have to see that 

(3.3) //9(P", J^(m -q)) = for all g > 
if and only if 

(3.4) H'^if"', T n^n{m + p)) = for all g > and < p < n. 

Let us first see that ()3.3|) implies ()3.4|) . By [T7], Lecture 14, the equalities ()3.3|) are 
equivalent to 

(3.5) //'?(P", J^(t)) = for all g > and t > m - q. 
Since r2p„(n) = Opn(— 1), we deduce from ()3.5|) that 

(3.6) i/«(P'',J^® fi;^„(n + t)) = for all g > and alH > m - g + 1. 

Using the exact cohomology sequence 
(3.7) 

> iJ''(P",r®J^(t)) ^ H'^ir,n^-\n-l)®J^it+l)) — > H'^+\F",n^4n)0j^it)) - 

associated to 

— > Q^^n) — y A"F ® Cpn — > Q'^-^n) — > 
together with the equalities (j3.6p and (j3.5|) we deduce 

(3.8) Hi(F'',J^0n'^-\n - 1 + t)) = for all g > and alH > m - g + 1. 

Going on using the exact cohomology sequence 
(3.9) 

> i7^(P", A'+V®.F(t)) i/^(P",l]^„(2)®^(t+l)) H'^+\F'',Q'^t\t+l)^Ht)) 

associated to 

— > n^t\i + 1) — > A*+V ® Cpn — > n^,,{i + 1) — . 

we deduce 

(3.10) i7«(P",J^®^]^„(^ + t)) = for all g > and alH > m-g + 1 
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which obviously imphes ()3.4j) . Let us prove the converse. To this end we consider the 
Eilenberg-Moore type spectral sequence (see Theorem 12 .221) 

(Ext"(/2(-P)^i+„+p,^)®Ext^(e?,£,+„+p)) 0<g<ri, -n < p < 

a+/3=q 

and we apply it to the case i = —m — n and Q = (9pn(t — m). So, we have 

a+/3=9 

By (D, i^"(P", f^fc^^ ® J^) = for all a > and all p, -n < p < and by Bott's 
formulas a non-zero cohomology group of line bundles on P*^, if^(P", Of>n{p — t)), corre- 
sponds only to /5 = or n and in the latter case p — t < —n — 1 (i.e. p < t — n — 1). 
Thus, E'f^ 7^ forces p + q < t — 1. Therefore, = for p + g > t and so 
= Ext*(Cpn(t - m), J^) = //*(P", J^(m - t)) for t > 1 or, equivalently, is m-regular in 
the sense of Castelnuovo-Mumford. □ 



Let us now prove that the main formal properties of Castelnuovo-Mumford regularity 
over projective spaces remain to be true in the new setting. 

Proposition 3.8. Let X be a smooth projective variety of dimension n with a geometric 
collection a = {So,Si,--- ,Sn) and let be a coherent Ox-niodule. If is m-regular 
with respect to a then the canonical map Hom(£^_m, ^) ® is surjective and T is 

k-regular with respect to a for any k > m as well. 

Proof. The first assertion immediately follows from the exact sequence (13. 2p of To 
prove the second assertion, it is enough to check it for k = m + 1. Since JF is m-regular 
with respect to a we have 

(3.11) Ext^(i?(-P)^_„+p, J^) = for all g > and all - n<p<0. 

In order to prove that JF is (m + l)-regular with respect to a we have to check that 

(3.12) Exf^iR^-P^S^rn-i+p, J^) = for all g > and all -n<p<0. 

To this end we apply the contravariant functor Hom(.,jF) to the exact sequence 

> £-m-l ^ Horn* {£^rn-l, £-m) ® £-m ^ Rs^m^-rn-l ^ 

and we get the exact sequence 

. Ext''(i?£_^_„_i,^) ^ Hom* (£_„_!,£_„) ® Ext''(£_„,^) ^ 

Ext^(^_,„_i,.F) Ext'^+i(i?£_^^^_i,^) ^ ■ ■ • . 
Since by dSUl), Ext''(^_„, JF) = Ext'^(i?^:_„^_™_i, J^) = for all g > 0, we get that 
Ext''(£^_m-i7 -F) = for all g > 0. Using again ()3.11|) and the exact sequence 



GEOMETRIC COLLECTIONS AND CASTELNUOVO-MUMFORD REGULARITY 



15 



we get that Ext''(i?f_„_,^_„_2, J^) = for all g > 0. 

Going on and using the consequent right mutations, we get for alH, l<'j<?7, — 1, 

Ext«(i?£__,i?^__, ■ ■ ■ ^) = for all q > 0. 

Hence, it only remains to see that 

Ext^(i?^__,i?£_., ■ ■ ■ Re_,^_J^m-n-uJ') = for all q > 0. 

The vanishing of these last Ext's groups follows again from (jH.llll taking into account 
that, by Definition EH 

Re Rr ■ ■ ■ Rf E 1 = R'^'^^E 1 = E 

□ 

Proposition 3.9. Let X he a smooth projective variety of dimension n with a geometric 
collection a = {Eo,Ei, ■ ■ ■ ,En), let T and Q he coherent Ox -modules and let 

(3.13) ^ J^i ^ J'a ^ -^3 ^ 

he an exact sequence of coherent Ox-modules. Then, 

(a) Rega{T2) < max{Rega{Ti),Reg„{J^z)}. 

(b) Reg^{J^®Q) = max{Reg^{J^),Reg„{Q)}. 

Proof, (a) Let m = max{Rega{J-'i), Rega^J-'s)}. Since, by Proposition 13. 8^ J^i and JF3 are 
both m-regular with respect to a considering the long exact sequence 

• • • ^ Ext^(i?(-^)£_^+„ J-i) Ext''(i?(-P)^_^+p,^2) ^ Ext''(i?(~P)^_„+p,^3) ^ • • • 

associated to ()3.13j) we get Ext^(_R'^~P)£^_m+p, ^2) = for any q > and —n < p < 0, 
which implies that Rega{T2) < fn. 

(b) It is enough to see that if JF is m-regular with respect to a and Q is s-regular with 
respect to a then ®Q is t = max{s, m)-regular with respect to a. Since, by Proposition 
13. 8[ and Q are both t-regular with respect to a and, moreover, the functor Ext's is 
additive we get 

Ext\R^-P^E^t+p,:F®G) = Ext^(i?(-P)^_t+p, J-) = Ext'^{R^-P^E.t+p,g) = 
for g > and —n < p < 0. Therefore, JF © ^ is t-regular with respect to a. □ 

The following Example will show that in Proposition 13. 9( (a) we can have strict in- 
equality. 

Example 3.10. We consider the geometric collection a = {Opn, (9pn(l), ■ ■ ■ , Oipn[n)) of 
locally free sheaves on P" and we denote by i^f a hyperplane section on P". For any 
n > r > 0, we have the exact sequence 

^ Opn(r - 1) ^ Cpn(r) ^ Onir) 0. 
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According to Proposition 13.51 Rega{Opn(r)) = —r and Rega{Opn(r — 1)) = — r + 1. So, 
Reg^{Opn{r)) < max{i?e^„(Opn(r - 1)), Reg^iOnir))}. 

In Proposition 13.71 we have seen that a coherent sheaf JF on P" is m-regular in the 
sense of Castelnuovo-Mumford if and only if it is m-regular with respect to the geometric 
collection a = (Opn, Opn(l), • • • ,Cpn(ri)). A more subtle problem is the following one. 
Let X^P" be a smooth projective variety, let be a coherent sheaf on X and let 
a = {So, ■ ■ ■ , £n) be a geometric collection of coherent sheaves on X. How are related the 
regularity of JF with respect to a and the Castelnuovo-Mumford regularity of its extension 
by zero via the embedding X'^P" ?. In next section, we will address this problem 
for the case of coherent sheaves on odd dimensional quadric hypersurfaces Qn C P"+^. 

4. Regularity of sheaves on Q„ 

Let r?, G Z be an odd integer {n = 2t + 1) and let Qn C P'"-+^ be a smooth quadric 
hypersurface. In ^2], M. M. Kapranov defined the locally free sheaves ipi, i > 0, on Qn 
and the Spinor bundle S on Qn to construct a resolution of the diagonal A C Qn x Qn 
and to describe the bounded derived category D^{Oq^ — mod). In particular, he got that 

OQ„(-n + 1), ■ ■ ■ , Oq„(-1), OqJ 

is a full strongly exceptional collection of locally free sheaves on Qn ([15^; Proposition 
4.9) and hence, according to Definition 12.151 Qn has a geometric collection of locally free 
sheaves. Dualising each bundle of the above geometric sequence and reversing the order, 
we get that 

a := ■ ■ ■ , OqSu - 1), S(n - 1)) 

is also a geometric collection of locally free sheaves on Qn- 

In this section we will give an elementary description of the locally free sheaves "i/^j and 
their basic properties (for more details the reader can look at and, for any coherent 
sheaf T on Qn, we will relate Reg^^J-') to the Castelnuovo-Mumford regularity of its 
extension by zero in the embedding i : Qn ^ P"+^. 

From now on, we set Vt^ := and we define inductively ipj: 

and, for all j > 2, we define the locally free sheaf i/jj as the unique non-splitting extension 
(Note that Ext\ijj.2,^'{j)\Qj = C): 

fi-'(j)|Q„ 0. 

In particular, '0^+2 = i^j for j > n and i/jn = S(— {n = 2t + 1). 

Before computing the right dual basis of any thread aj = {£j,£j+i, ■ ■ ■ ,£j+n) of the 
helix TCa = {Sj}j^i associated to a, we collect in the following Lemma the cohomological 
properties of the Spinor bundles we need later. 

Lemma 4.1. Let n ^ Z be an odd integer, let Qn C P"+^ be a smooth quadric hypersurface 
and let S be the Spinor bundle on Qn- Then, 

(i) H^{Qn, S(t)) = for any i such that < i < n and for all t G Z. 
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(ii) //°(g„,S(t)) = for allt<0 and /i°(g„,S) = 2"^. 

(iii) ExtXS(j), S) = ^ ^ for any I < j < n. 

{0 if i ^ j 
. /or any 1 < j < n. 
C if i = j 

Proof. The assertions (i) and (zi) follows from [21]; Theorem 2.3. The assertion {iii) 
follows by induction on j, using (i) and {ii) and the long exact sequence 

n+l n+1 

■ ■ ■ ^ Ext'-i(OQ„(jr^,S) ^ Ext-i(S(j-l),S) ^ ExtXSO-),S) ^ ExV{Oq„{j)'^ ,J:) 
obtained by applying the functor Hom(-, S) to the exact sequence 

n + l 

^ SO- - 1) ^ OQ„0r^ ^ - 0. 

The assertion {iv) follows from Proposition 4.11. □ 

Proposition 4.2. Let n & Z be an odd integer, let Qn C P"+^ be a smooth quadric 
hypersurface and let = be the helix associated to 

^ = Oq„(1), ■■■,OQ^{n- 1), S(n - 1)). 

Let us denote by au the thread {£k,£k+i, ■ ■ ■ ,£k+n)- Then: 

(a) The right dual base of ao is 

- l),i)n-i{n),^n~2{n), ■ ■ ■ , i)i{n) , tpo{n)) . 

(b) For any j , 1 < j < n, the right dual base of the geometric collection 

= (Oq^U), ■■■,OQ„{n- 1), S(n - 1), OQ„{n),OQ^{n + I), . . . ,OQ„{n + j - 1)) 

is 

{OQ,Xn + J - 1), ^*(n + J - 1), ■ ■ ■ , + J - 1), 

S(n + j - l),ipn_j_i{n + j), ■ ■ ■ ,ijo{n + j)). 

(c) For any A G Z, the right dual base of the geometric collection 

axin+i) = {OQ„{Xn),OQ„{l + An), ■ ■ ■ , OQ„{n - 1 + An), S(n - 1 + An)) 

is 

(S(n - 1 + An),z^„_i((A + l)n), ^„_2((A + l)n), ■ ■ ■ ,z^i((A + l)n),z^o((A + l)n)). 

(d) For any j , 1 < j < n and any A G Z, the right dual base of the geometric collection 

cTj+xin+i) = {OQ„{j + An), ■ ■ ■ , OQ„(n - 1 + An), S(n - 1 + An), 

Oq,X{X + l)n), ■ ■ ■ , Oq„0- - 2 + (A + l)n), Oq„(j - 1 + (A + l)n)) 

IS 

(C)q„((A + l)n + J - 1), ^i*((A + l)n + J - 1), ■ ■ ■ , ^;_i((A + l)n + j-l), 
S((A + l)n + j- 1), 7/;„_,_i((A + l)n + j), ■ ■ ■ , ^o((A + l)n + j)). 
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Proof, (a) By Proposition 4.11 and using the fact that the right dual basis of an ex- 
ceptional collection is uniquely determined up to unique isomorphism by the orthogonality 
conditions described in Remark 12.111 we get that the right dual basis of the exceptional 
collection OgJ-n + 1), ■ ■ ■ , Oq„(-1), OqJ is 

(Oq„,^*,---,C_„S*(1)). 

In particular, we have 

(4.1) R^^^Og^i-j) = for < i < n - 1; and 

= S*(l). 

Let us now compute the right dual base of ctq. Since R^'^^T,(n — 1) = S(n — 1) and 
R^^'^Oq^ = Oq^i^n), according to the definition of right dual base we only need to compute 
R^^^O{n-j) for 1 < j < n-1. It follows from Lemma and the fact that S*(-n+l) = 
S(— n), that 

RU)0{n - j) = Rs(„-i)OQ„(n-i)-OQ„(n-j+i)0{n - j) 

= {Lj^{-n)OQ„{-n+l)-OQjj~n-l)0{j - u))* 

By 2.8.1, 

= {R^^)OQS-j)y®OQSn) 

where the last equality follows from ()4.1|) . Hence, R^^^O{n — j) = ^n-jin) which finishes 
the proof of (a). 

(b) Applying Lemma 231 (c) to (HH)), we get that 

(4.2) Rip)OQ^{n + j-l-p) = rp{n + J-l) for < p < j - 1. 

On the other hand, by Lemma f4. II we have: 
- For any a G Z and j<t<n + j — 1 

Ext"(S(n + j-l),OQ„(t)) = 0; and 

'O a^j 
C a = j. 

For any aGZ, n — j — l<t<0 and i<7<n + j — 1 
Ext°(?^t(n + j),S(n- 1)) = 0; and 

if n — a = t = 'j — j 



Ext"(S(ri + i-l),S(n-l)) 



otherwise. 



Since the right dual base of an exceptional collection is uniquely determined up to 
unique isomorphism by the orthogonal conditions given in Remark 12.111 it follows from 
(|4.2p . these last cohomological relations and from Lemma f4. 11 that indeed 

{OqAn + J - 1), riin + j -I),r2{n + J - , rj-i{n + J-1), 

S(n + j - l),^„_j_i(n + j), ■ ■ ■ ,iJJiin + j),'ipo{n + j)) 
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is the right dual base of aj. 

(c) and (d) follows from (a) and {b), respectively, and Corollary 12.241 □ 

Let J-" be a coherent sheaf on Q„ and let be its extension by zero in the embedding 
Qn^^"'~^^- We are now ready to compare Rega{J-') to Reg'~"^^ {i^T) and state the main 
result of this section. 

Theorem 4.3. Let n he an odd integer and let Qn'^P"^'^ be a quadric hyper surf ace. We 
consider the geometric collection a = (Oq„, ■ ■ ■ , OQ„{n — 1), S(n — 1)). For any coherent 
sheaf J-" on Qn we have: 

L^^^^J < Reg^^\^.:F) < [I^^f^J + 1. 

T\i I 1 T\i I X 

Proof. First of all, we will see that Reg'~^^\i^J^) < [ "'^^^/'^^ J +1- To this end, since for 
alH G Z and < g < n, 

(4.3) iJ"+i(P"+\2,^(t)) = 0, //'?(P"+\?;,^(t)) ^ H'^iQn^Ht)), 

we will see that if JF is m-regular with respect to a then 

H\Qn,J^{m + X + l-i)) =0, l<i<n 
where A := [;^J . Write —m = \{n + 1) + r with < r < n. So, 



— m — n 



(A-l)(n + l) + r + l ifO<r<n-l 
A(n +1) if r = n. 



Therefore, a-rn-n = {^-m-n, ■ ■ ■ ,S~m) is equal to 

(Oq„((A -l)n + r + !),■■■ , Oq„{{\ - l)n + n - 1), E((A - l)n + n - 1), 
OQAXn),OQ^{Xn + 1), . . . , O^JAn + r)), 

ifO<r<n — 1 and is equal to 

(OQ„(Ari), OgJAn + 1), . . . , Og^iXn + n-l), S(An + n - 1)) 

if r = n. We consider the Eilenberg-Moore type spectral sequence (see Theorem I2.22|) 

(Ext"(/2(-*')^,+„+p,^)®Ext^(e;,£, 



a+P=q 



: ^ ^P+r,9-r+l^ ^ ExtP+'?(6;, ^) 

and we apply it to the case i = —m — n and Q = OQ^{t — m — X — 1). So, in the square 
< g < n, —n < p < we have 

[Ext"{R^-P^S.^+p,r)^Ext^{OQ„{t-m-X-l),S.m+p))- 

a+P=q 
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Since T is m-regular with respect to a, Ext"(/?("P)£^_m+p, ^) = for all a > and all 
—n < p < 0. On the other hand, if < r < n — 1, then 

ri/^(Q„,OQ„(2-t + p)) \i -n<v<-r-2 
Ext'3(OQ„(t - m - A - 1), = <^ if^(Q„, + p + 1)) if p = -r - 1 

and if r = n, then 

Therefore, applying Serre's duality and Lemma (4.11 we get that the only non-zero Ext's 
groups Ext^((9Q^(t — m — A — 1), £^_m+p)) correspond to /5 = or /3 = n and in the latter 
case — r < p < and p<t — 1 — nor — n < p < —r — 1 and p < t — 2 — n. Thus, E'f 7^ 
forces p + g < t — 1. Therefore, E"^ = for p + q > t and so for any t > 0, 

Ext*(OQ„(t-m - A - 1),J^) = i/*(Q„,J^(m + A + 1 -t)) = 0. 

In order to prove the other inequality, we will see that if i^J-' is (m + A)-regular in the 
sense of Castelnuovo-Mumford, then is m-regular with respect to a, where A := L^^J- 
If is m-regular, then it is also (m + 7)-regular for all 7 > and we have 

(4.4) = H'{F''+\i,J^{t)) = H'{Qn,T{t)), for alH > m + A-z, i > 0. 

We write — m = A(?t. -|- 1) -|- r with < r < n. If r ^ n then a-m-n is given by 

(Oq„((A - l)n + r + 1), ■ ■ ■ , Oq„{{X -l)n + n- 1), S((A -l)n + n-l), 
OQ„{Xn),OQ^{Xn + 1), ■ ■ ■ , Og^iXn + r)), 

and by Proposition 14.21 its right dual base is given by 

{Og^iXn + r), V'*(An + r), ■ ■ ■ , V^;(An + r), 
S(An + r), '0„_r_2(An + r + 1), ■ ■ ■ , V^olAn + r + 1)), 

and if r = n, a^m-n is equal to 

(OgJAn), OQ„(An + 1), . . . , 0Q„(An + n - 1), S(An + n - 1)) 

and by Proposition 14.21 its right dual base is given by 

(S(r2 - 1 + An), ^„_i((A + l)n), V'„_2((A + l)n), ■ ■ ■ , ^i((A + l)n),Mi^ + 1)^))- 

So, according to Definition 13.11 we have to see that for any q > 

(2) Ext''(OQ„ (An + r), ^) = H^Q^, T{m + A)) = 

{ii) Ext'^(V';(An + r),J^) = Ext^(^;,J^(m + A)) =0 \<a<r 
{in) Ext''(V'„_/3(An + r + l),J^) = Ext^(V'n-/3,J^(m + A-l)) =0 r + 2<(3<n 
(iv) Ext''(S(An + r),J^) = Ext''(S, J^(m + A)) = 

if r 7^ n and we have to see that 

{v) Ext'?(^/'„_„((A + l)n),J^) = Ext'?(^/'„_„,J^(m + A)) =0 l<a<n 
{vi) Ext'?(S(An + n - 1), J^) = Ext'?(S, J^(m + A + 1)) = 
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iir = n. From ()4.4|) we immediately get (z). Equalities (ii), {Hi) and (f) are consequence 
of the following stronger results 

(4.5) Ext'' {ipj,T{t)) = for any a > 0, < j < n, and t > m + A - a, 
and 

(4.6) Ext"(?/^*, J^(t)) = for any a > 0, 1 < j < r, and t > m + A - a. 

We will prove ()4.5|) by induction on j. Analogously, we can prove ()4.6|) and we right it 
to the reader. If j = 0, it follows from (jO)) that Exf'itjjo, T{t)) = //"(g„, J^(t)) = for 
all a > and t > m + X — a. Assume j = 1. Restricting to Qn the Euler sequence and 
applying the functor Ext(-,JF(t)) we get the exact sequence 

■ ■ ■ Ext"(0^:2^^(t)) ^ Ext°(^i,^(t)) ^ Ext-+i(OQ„(l),^(t)) ^ ■ ■ • . 

By (D, Ext"+^(CQ„(l),J^(t)) = i/"+n<5n,-^(^- 1)) = for t - 1 > m + A-a - 1 and 
Ext"(OQ+^ J^{t)) = for all a > and t > m + A - a. Hence 

(4.7) Ext''(V'i, J^(t)) = for all a > and t > m + A - a. 
Before going ahead with the general case, let us prove the following 

Claim: For any p > 1, a > and t > m + X — a, 

Ext"(^]p(p)l,„,^(^)) = o. 

Proof of the Claim: We will prove it by induction on p. If p = 1, by ()4.7|1 . 

Ext"(fii(l)|^^,^(t)) = Ext"(^i,^(t)) = 

for any a > and t > m + X — a. Assume it holds for p and let us see the case p + I. 
Applying the functor Ext(-,^(t)) to the exact sequence 

- Q^^\p + 1)|,„ Q-ip + 1)|,„ - 

obtained by restricting to Qn the p-th exterior power of the dual of the Euler sequence 
on P"+^, we get the long exact sequence 

■ • ■ ^ Ext°(4r\^(t)) ^ Ext"(l]^+i(p+l)|,^,^(t)) ^ Ext"+^(fi^(p+l)|^„,^(t)) ^ ■ ■ 

By hypothesis of induction, Ext"^-^ {QP{p+l)\^^, J^{t)) = Ofor any t— 1 > m+X — a — 1 and 

by (gai), Ext"(0^''+'^J^(t)) = Ofor anyt > m+X-a. Hence, Ext°((]P+nj5+l)|Q„ , ^(t)) = 
for any t > m + X — a and a > which finishes the proof of the Claim. 

Let us now prove ()4.5|) by induction on j. The first two cases have been already done. 
Assume fl4.5|) holds for j > 1 and let us see that it holds for j + 1. Applying the functor 
Ext(-,^(t)) to the exact sequence 

n^U)\Q. — — ^ ^.-2 ^ 

we get the long exact sequence 

■ ■ ■ ^ Ext-(^,_i,^(t)) ^ Ext°(V;,+i,^(t)) ^ Ext"(^]^■+l(J + l)|Q„,^(t)) ^ ■ ■ ■ . 
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It follows from the Claim that Ext'^{n^+\j + l)\Q^,J^{t)) = for all a > and t > 
m + X — a and by hypothesis of induction Ext"('0j_i, J-'(t)) = for all a > and 
t > m + X — a. Hence we obtain 

Ext"(V^,+i,^(t)) = 

for any a > and t > m + X — a, which finishes the proof of {ii), {Hi) and (v). Finally, 
using the fact that ipn = S(— we deduce from ()4.5p that (iv) and (vi) also hold. □ 

Now we will show that Theorem 14.31 is optimal, i.e., both inequalities can be realized. 
First, we will compare Rego-{Sj) to Reg'^^\i^£j) where £j is part of the helix = {Sj}j^z 
associated to a and later we will compare Reg„{ipi{?> + An)) to Reg^'^ {i^lipil?) + An))). 

Proposition 4.4. Let n he an odd integer and let i : Qn P"+i be a quadric hypersurface. 
Let Ha = {Sj}j<zz be the strict helix associated to a = {Oq^, • • ■ , OQ„(n — 1), S(n — 1)). 
For any integer j G Z, we write j = A(n + 1) + r with < r < n. Then, we have 

Reg^iSj) = -j 
Reg^^{i,Sj) = -j + X + l. 

In particular, the following relation holds: 

Reg^iSj) + A + 1 = Reg^^\i,£j). 

Proof. By remark 12.141 ifO<r<n — 1, we have 

= ^A(n+l)+r =Sr® {K* f' = Og^iXu + r) 

and if r = n, then we have 

= ^A(n+l)+n = £n® (K^f^ = S(An + n - 1). 

Using the exact sequence 
we get that 

//"(p^+i^ i^OQ„{t)) = for alH G Z, 1 < g < n - 1 and q = n + 1 
//"(F"+i, i^OQ„{t)) = for alH > -n + 1, 

and we conclude that Reg^^'^ {i^.OQ^{s)) = — s + 1. In particular, if j = A(n + 1) + r with 
0<r<n — 1, we have 

Reg^^'{i,£j) = Reg^^^i^OQ^Xn + r)) 
= —An — r + 1 
= -J + A + 1 
= Reg^iSj) + A + 1 

where the last equality follows from Proposition 13.51 So, it only remains the case j = 
A(n + 1) + n. Using the isomorphism 

/7''(p"+\2,s(t)) = //^(g„,s(t)) 
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and Lemma 14.11 (z) — (n), we obtain that Reg''"^ {i^J^{t)) = —t. Therefore, 
A(n + 1) + ra, we have 

Reg^^'\i,Sj) = Reg^^^i.EiXn + n - 1)) 
= —Xn — n + 1 
= -j + X + l 
= Reg„{£j) + X + 1 

where again the last equahty follows from Proposition 13.51 
Proposition 4.5. With the above notations, we have: 

(i) Reg^^ {i,{ilJi{3 + Xn))) = -2 - Xn. 
{ii) Reg^{'ilJi{3 + Xn)) = -2- X{n + 1). 

Proof. {{) It follows from the fact that H^{Qn, — i)) = for alH > 1 and 

(ii) Since by Proposition 14.21 the right dual basis of a2+\(n+i)-n is 
(Oq„ (An + 2), ^t(An + 2), t/j^iXn + 2), S(An + 2), ^„_4(An + 3), ■ ■ ■ , ^o(An + 3)) 
and the right dual basis of cr3+x{n+i)~n is 

(0Q„(An + 3),V'i(An + 3),V'2*(An + 3),7/;3*(An + 3),S(An + 3),V^„_5(An + 4),--- ,^o(An + 4)) 

we easily check (taking into account that ^/'o(An+4) = OQ^{Xn+4) and that H^{Qn, ^jJl{—l)) = 
C) that '0i(3 + An) is (—2 — A(n + l))-regular with respect to a but not (—3 — A(n + 1))- 
regular with respect to a. □ 

5. Final comments 

In this section, we will first gather the problems that arose from this paper and we will 
end with some final remarks. 

Problem 5.1. To characterize smooth projective varieties which have a geometric col- 
lection. 

Let X be a smooth projective variety of dimension n. We know that a necessary 
condition for having a geometric collection is that the rank of the Grothendieck group 
Ko{X) is n+1 and X is Fano. We would like to know if these conditions are also sufficient. 

The main goal of this paper was to generalize the notion of Castelnuovo-Mumford 
regularity for coherent sheaves on a projective space to coherent sheaves on other smooth 
projective varieties X. We have succeed provided X has a geometric collection of coherent 
sheaves. It would be nice to extend the definition to the case of smooth projective varieties 
which have a full strongly exceptional collection of sheaves (not necessarily geometric). 
Hence, we propose: 

Problem 5.2. Let X be a smooth projective variety and let JF be a coherent sheaf on 
X. To extend the definition of regularity of JF with respect to a geometric collection cr to 
regularity of JF with respect to a full strongly exceptional collection. 
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It is well known that Beilinson's theorem ( IJ) and Castelnuovo-Mumford regularity 
of sheaves play a fundamental role in the classification of vector bundles on projective 
spaces. In a forthcoming paper we will apply the results obtained in this work to study 
moduli spaces of vector bundles on quadric hj^ersurfaces. We have the feeling that 
Beilinson-Kapranov type spectral sequence f Theorem 12 .211) . Eilemberg-Moore type spec- 
tral sequence fTheorem l2.22|) and the regularity with respect to a geometric collection will 
play an important role in the classification of vector bundles on varieties with a geometric 
collection. 
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